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~ The MAILING DATE of this communication appears on the cover sheet with the correspondence address- 

All claims being allowable, PROSECUTION ON THE MERITS IS (OR REMAINS) CLOSED in this application. If not included 
herewith (or previously mailed), a Notice of Allowance (PTOL-85) or other appropriate communication will be mailed in due course. THIS 
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International Bureau (PCT Rule 17.2(a)). 
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INFORMAL PATENT APPLICATION (PTO-152) which gives reason(s) why the oath or declaration is deficient. 
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Identifying indicia such as the application number (see 37 CFR 1. 84(c)) should be written on the drawings in the front (not the back) of 
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DETAILED ACTION 

1 . Claims 1-20, 22-28, 30-43, and 45-46 are pending. 

2. Claim 1 is to an "apparatus", and is statutory since it recites means plus 
language, requiring physical hardware as supported in the specification. 
The claim is statutory. 

3. Regarding Claim 43, the claim is in a method claim format and cannot 
(and would not) reasonably or realistically be carried out without the aid of 
particular programmed computer due to the computational complexity of 
the recited steps. Thus, the claim passes the machine-or-transformation 
test (In re Bilski) and is eligible for patent protection. 

4. Claim 46 is drawn to a non-transitory computer readable recording 
medium, and given the broadest reasonable interpretation of the claim in 
light of the specification and Official Gazette Notice (1251 OG 212, made 
available February 23, 2010), concludes that the claim fall within a 
statutory category. Note: Claim 46 was modified in an Examiner's 
Amendment found in the previous Notice of Allowance on 05/25/2010. 



Continued Examination Under 37 CFR 1.114 

A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1 .17(e), was filed in this application after issue of the application. 
Since this application is eligible for continued examination under 37 CFR 1.114, 
and the fee set forth in 37 CFR 1.17(e) has been timely paid, the application from 
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issue has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission 
filed on 09/02/2010 has been entered. 

Information Disclosure Statement 

Examiner has considered all references cited in the Information Disclosure 
Statement (IDS) filed on 09/02/2010. 

Allowable Subject Matter 

3. Claims 1-20, 22-28, 30-43, and 45-46 are allowed over the prior art of 
record. Examiner has reviewed the supplied references in the IDS, and Examiner 
has determined that the claims are allowable. 

The following is an examiner's statement of reasons for allowance: 

The following prior arts were found: 

Sun et al. (US Patent 6,731 ,799) discloses an Object tracking and 
segmentation method for video frames using iterative pixel grouping. Where the 
object contours are derived by relaxing the edge constraints on contour changes 
from one frame to the next. The contour energy is minimized while also 
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considering normalized background information and motion boundary 
information. The background and boundary information define the object 
boundary propagation from one frame to the next, relaxing the constants on 
contour topography. 

Magarey (US PGPub 2003/0053661) outlines a video feature tracking 
method for digital video analysis, involves updating reference data with feature 
data when difference between reference data and feature data is larger than 
predetermined value Where the feature position in current frame is estimated 
based on the position in previous frame and the feature data is extracted from 
the current frame. The extracted feature data is compared with reference data 
and when the difference between feature and reference data is larger than a 
predetermined value, and then the reference data is updated with feature data. 

Sawasaki et al. (U.S. 5,838,365) teaches a local region image tracker for 
continuous tracking, suitable for high speed tracking of several objects in a 
scene. The image tracker includes an image data bus which transfers input 
image data from an image pick-up (camera). Several correlation tracking 
processors are coupled to the bus in parallel. The processors carry out a tracking 
process independently with respect to a search image. The tracking process for 
several search images is carried out in a distributed manner by the processors. 

Itokawa et al. (U.S. 7,024,040) discloses an image processing procedure 
involving connecting points between a background block and object block for 
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forming closed curve from which outline of objective image is extracted. When 
significant activity is detected, block classification is performed to background, 
object and boundary blocks to detect their contact points which is set as initial 
stage and closed curve is termed by points sequentially from which outline 
objective image extracted. 

Kondo et al (U.S. 2003/0156203) discloses an image processing device 
capable of determining a mixing ratio indicating the state in which a plurality of 
objects such as a background image and an image of a moving object are mixed. 
Kondo further teaches not only extracting the background pixel data but also data 
on a pixel of interest and its adjacent pixels. The method generates a plurality of 
relations among the pixel of interest, the adjacent pixel data, and the background 
pixel data. The method computes a mixing ratio indicating the mixed state of the 
objects in the real world with respect to the noted pixel by using this relation. 

Watanabe et a. (JP 2002-369071 ) discloses a method for determining the quality 
of an image for use in an adaptive filter, where a metric for measuring an image's 
sharpness is used, the metric being a sum of absolute differences between a 
pixel under consideration (pixel of interest) and adjacent pixels to the pixel under 
consideration 



Claim 1 : An image processing apparatus ( Sun, Fiq.1 ) comprising: 
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position estimating means (Sun, Fiq.2, El 28 ) for estimating the position of 
a second point representing a tracking point in an image of a temporally next unit 
of processing ( Sun, Column 7. Lines 49-53. Lines 59-66, Column 8, 32-35, 
estimates the position of an edge point(s) of an object using an auto- 
predicative search, to track the edge point(s) in the temporally next frame ), 
the second point corresponding to a first point representing the tracking point in 
an image of a temporally previous unit of processing ( Sun, Fig. 10A, Fig. 10B, 
Column 1. Lines 22-25. Column 8. Lines 29-33 ): 

generating means for generating estimated points serving as candidates 
of the first point when the position of the second point is inestimable ( Sun. 
Column 8. Lines 26-29. if a scene change is detected fa second point is 
inestimable) then the process is reinitialized (building new models and 
tracking new points) ): 

determining means for determining the second point in the next unit of 
processing on the basis of the estimation result of the position estimating means 
when the position of the second point in the next unit of processing is estimable 
(Sun. Column 7. Lines 49-53. Lines 59-66. Column 8. 32-35. if a scene 
change has not occurred (the second point is estimable) then the position 
of an edge point of an object is estimated using an auto-predicative search 
which tracks the edge point in the temporally next frame ): and 

selecting means for selecting the first point from among the estimated 
points when the position of the second point is inestimable ( Sun. Column 8. 
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Lines 26-29, Column 7, Lines 38-46, if a scene change is detected (a 
second point is inestimable) then the process is reinitialized, where the 
user can select point(s) for tracking (selecting means) or the computer can 
perform a segmentation to generate the new edge point(s) to track 
(selecting means) ), wherein 

the determining means includes: 

evaluation value computing means for computing an evaluation 
value representing a correlation between pixels of interest representing at 
least one pixel including the first point in the temporally previous unit of 
processing and the corresponding pixels representing at least one pixel in 
the temporally next unit of processing and defined on the basis of a motion 
vector of the pixels of interest (Marqarev. Fig. 2A, Fig. 2B, f00081. Lines 
1-12, r00091. Lines 1-12, r00811. Lines 104, f00881. Lines 1-7, and 
r00871. Lines 1-12, an evaluation means. Loss Of Target, (position is 
estimable or inestimable) is determined by comparing (correlation 
taught as a suitable method) the pixel between a reference data set 
(data from a previous frame) an the feature set (data extracted based 
on region around a position estimated by the motion vector) ): 

variable value computing means for computing a variable value 
representing the variation of a pixel value with respect to the pixels of 
interest ( Marqarev. r00081. Lines 1-5, r00871. Lines 1-12, a (variable) 
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value represents the difference (variation) between pixel values of 
the reference data set and the feature set (pixels of interest) ): 

and accuracy computing means for computing the accuracy of the 
motion vector ( Marqarev. r00081. Lines 1-5. r00871. Lines 1-12. the 
accuracy of the motion vector is determined using a threshold on the 
pixel differences between a reference data set an the feature set), 
this value represents accuracy (a difference of 0. would be exact 
match, a larger number would correspond to a poorer match), and if 
this accuracy value is under a predetermined threshold the accuracy 
of the new motion vector is not used, rather the pervious position is 
used ), and 



the variable value computing means computes the variable value 
representing the sum of values (Watanabe, Abstract, r00221 discloses a 
method for determining the gualitv of an image, based upon a sharpness 
measure using the sum of absolute differences between a pixel under 
consideration (pixel of interest) and adjacent pixels to the pixel under 
consideration ) obtained by dividing the sum of absolute differences between the 
pixels of interest and the adjacent pixels that are adjacent to the pixels of interest 
in a block including the pixels of interest by the number of the adjacent pixels. 
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Applicant uniquely claimed a distinct feature in the instant invention, which 
are not found in the prior art, either singularly or in combination. The feature is 
"the variable value representing the sum of values is obtained by dividing the 
sum of absolute differences between the pixels of interest and the adjacent pixels 
that are adjacent to the pixels of interest in a block including the pixels of interest 
by the number of the adjacent pixels" these, in combination with the other 
respective claim limitations, that is the cited references do teach a variable or 
metric of dividing the sum of absolute difference (SAD) by the number of 
adjacent pixels, that is normalizing the SAD value by dividing by the number of 
adjacent pixels. 

These features are not found or suggested in the prior art 

Independent Claims 43 and 46 allowed for similar reasons as mentioned 

above. 

Any comments considered necessary by applicant must be submitted no 
later than the payment of the issue fee and, to avoid processing delays, should 
preferably accompany the issue fee. Such submissions should be clearly labeled 
"Comments on Statement of Reasons for Allowance." 

Conclusion 

4. Any inquiry concerning this communication or earlier communications from 
the examiner should be directed to Jason Heidemann whose telephone number 
is (571)-270-5173. The examiner can normally be reached on Monday - 
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Thursday/7:30 A.M. to 5:00 P.M.. 

If attempts to reach the examiner by telephone are unsuccessful, the 
examiner's supervisor, Matthew Bella can be reached on 571-272-7778. The fax 
phone numbers for the organization where this application or proceeding is 
assigned are 571 -273-8300 for regular communications and 571 -273-8300 for 
After Final communications. TC 2600's customer service number is 571-272- 
2600. 

Information regarding the status of an application may be obtained from 
the Patent Application Information Retrieval (PAIR) system. Status information 
for published applications may be obtained from either Private PAIR or Public 
PAIR. Status information for unpublished applications is available through 
Private PAIR only. For more information about the PAIR system, see http://pair- 
direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll- 
free). If you would like assistance from a USPTO Customer Service 
Representative or access to the automated information system, call 800-786- 
9199 (IN USA OR CANADA) or 571-272-1000. 

/Jason Heidemann/ 10/21/2010 
Examiner, Art Unit 2624 



/sath v. PtrwM^avoor/ 



Sath V. Perungavoor 

Primary Examiner, Art Unit 2624 
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